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(57) Abstract: Communication system comprising user terminals (2, 12) operable by users (1) and connecting means (3). Connected 
to a "personal assistant" server (6) is a terminal (7), operated by a human "personal assistant" (8) who can be called up by users to 
provide information or offer other services. The server (6) is connected to a users database (9) containing user-specific data and 
settings, whereby the server, on detection of a call from a user terminal (2, 12) to the "personal assistant" terminal (7), reads out the 
data and settings of the calling user from the database. The server (6) is connected to internal or external data systems (13, 15), which 
are accessible and operable by the "personal assistant" terminal (7) with control by user data and settings called up from the users 
database (9). The data systems can be an e-mail system, a diary system, internal or external information systems, an SMS system, a 
fax system, a unified messaging system, etc. 
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Communication system 

FIELD OF THE INVENTION 

The invention relates to a communication system comprising 
5 user terminals operable by users and connecting means for 
connecting the user terminals ic a telecommunications 
network. The user terminals referred to below car. include 
to be voice terminals. 

10 BACKGROUND OF THE INVENTION 

A communication system of this kind is generally known as a 
private or public telephony system. The object of the 
present invention is to provide a system by which 
personified and personal assistance is offered to a user, 

15 which in fact amounts to a personal secretary function and 
which is intended especially for business and small- 
business use and is particularly well suited for 
teieworking "communities", etc. In contrast with a number 
of known systems, the present system does not, in 

20 principle, make use of "voice response" or "voice 

recognition" etc., but uses a human "personal assistant" or 
"operator" with sufficient resources at his or her disposal 
to offer very efficient personal help to a variety of 
users. 

25 

SUMMARY OF THE INVENTION 

The communication system according to the invention 
comprises a "personal assistant" server connected to the 
connecting means, to which server a "personal assistant" 

30 terminal is connected, which can comprise a voice part and 
. a data part and which can be operated by a human "personal 
assistant" who can be called up by the users via the 
connecting means. The "personal assistant" server, together 
with the personal "operator" who makes use of the 

35 facilities of the server, is part of the system. 

In order to have all relevant data "on hand" when a user 
calls, the server is connected to a users database 
containing data about the various users, whereby the 
server, on detection of a call from a user voice terminal 

40 to the voice part of the "personal assistant" terminal, 
reads out the data of the calling user from the database 
and makes these data available to the data part of the 
"personal assistant" terminal. This enables the "operator" 
to see on the screen which user is calling as well as the 

45 user's relevant personal data. With the aid of these data, 
the operator can perform actions on behalf of the calling 
user, such as reading the user's e-mail etc., making use of 
the user-specific data and settings withdrawn from the 
database, namely the "username" , "'password" and 

50 ^preferences", which are not shown on the screen but are 
used "underwater" for activating the user's e-mail account 
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etc. (without the operator being able to read the username 
or - in particular - the password) . Examples of this will 
be given in the working example. The users database can be 
connected via the connecting means to user data terminals, 
5 thus enabling the users themselves to read or modify their 
data . 

As mentioned above, a particular object of the present 
invention is the support by means of the "personam 
assistant" server of the "personal assistant" in voice 

10 communication between the (voice) terminal of the user and 
the voice part of the terminal of the "personal assistant . 
The invention is not, however, as mentioned above, limited 
to this: the "personal assistant" server can also, by 
providing the "personal assistant" with specific user data 

15 and making user-specific settings, offer assistance and 
support when the communication between the user and the 
"personal assistant" proceeds via their (alphanumeric or 
graphic) data terminals. For such data communication as 
well, the "personal assistant" server can read ouz the 

20 user-specific data and settings from the database with 

reference to the address of the "calling" data terminal of 
the user. 

As well having access to the personal users data, the 
"operator" can also be connected by means of his/her 
25 terminal and the "personal assistant" server to internal or 
external data systems (or "data-processing systems"), which 
can be operated by means of the "personal assistant" 
terminal. In many cases, depending on the sort of data 
system, the data system is operable by the "personal 
30 assistant" with (co-) control by user data of the calling 
user called up by the server from the users database. The 
data system may, for example, be an e-mail system; it is 
clear that the "personal assistant" - for example m reply 
to a guery by the user to the "personal assistant": "Is 
35 there any mail for me?" - can only access that e-mail 

system by using user data (from the users database) such as 
login name and password of the user in question. The data 
system can also be a (personal) diary system (often 
integrated with the e-mail system) or an information 
40 system, for example a public transport information system 
that is consulted by the "personal assistant" at the user's 
request ("When is my appointment with Mr. P." or "When does 
the first train leave for G . " ) . Other possibilities are an 
SMS system, a fax system ("Are there any faxes for me" or a 
4 5 "unified messaging" system ("Have any important messages 
arrived?"). Incidentally, it is also envisaged that the 
"personal assistant" can also - at the request of the user 
- send messages (e-mail, fax, SMS) or make appointments and 
enter them in the user's diary, etc. ("Miss A., please send 
50 an SMS message to X. to say I will be taking a later 

train. ") . , , ^ . . . . , 

The invention will now be described in more detail with 
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EXAMPLES . . 

Figure 1 shows a communication system comprising user voice 
terminals 2 operable by users 1 and connecting means, 
namely a network 3 . Via a switch 4 the user voice terminals 
can be connected to a telecommunications network 5. Via 
another switch 4 the network 3 can be connected to a (for 
example IP based) data network 14. As well as the user 
voice terminals 2, the network 3 has connected to it, 
amongst other things, a "personal assistant" server 6, 
which is connected to a "personal assistant" terminal 7. 
This terminal 7 comprises a voice part 10 and a data part 
11 and can be operated by a human "personal assistant" (or 
15 "operator") 8 who can be called up by the users via the 
connecting means 3 and also vice versa. The "personal 
assistant" can also forward telephone calls to telephone 
sets etc. connected to the network 5. 

The server 6 is connected to a users database 9 containing 
data about the various users 1. When a call from a user 
voice terminal 2 to the voice part 10 of the "personal 
assistant" terminal 7 is detected, the server reads the 
data of the calling user from the database and sends it to 
the data part 11 of . the "personal assistant" terminal 7.. 
The users database 9 is also connected via the connecting 
means 3 to user data terminals 12, enabling the users 1 to 
read or modify their data. 

The server 6 is additionally connected to various internal 
data systems 13 and/or - via a network 14 - to external 
data systems 15, which are accessible and operable by the 
"personal assistant" 8 by means of the "personal assistant 
terminal 7. These data systems 13 and 15 are operable by 
the "personal assistant" 8 by means of the "personal 
assistant" terminal 7 with control by user data (data, 
settings, parameters) of the calling user 1 called up by 
the server 6 from the users database 9. The data system can 
be an internal (or external) e-mail system 13 (or 15 
respectively), a diary system, an information system, for 
example an (external) Internet-based system or an 
(internal) intranet-based system. The data system can also 
be a Short Message System (SMS), a fax system or a unified 
messaging system. 

If user 1 calls the "personal assistant" 8 (or more 
accurately server 6) via telephone set 2 and network 3, the 
extension number of user 1 is forwarded to the "personal 
assistant" server 6. On the basis of this extension number 
("CLI"), server 6 searches in its database 9 for the 
personal data and settings of the user and reads these out. 
Some of these personal data - such as the name of the 
caller - are sent to screen 11 of the "personal assistant" 
terminal 7, while a call signal sounds in the voice part 
10. The "personal assistant" 8 can now answer the call in a 



30 



35 



40 



45 



50 



WO 01/86928 



PCT/EP01/05482 



4 

personal manner ("Good afternoon, <user name>, how can I 
help you?") with the aid of the data (such as the user 
name) displayed on the screen 11. The user 1 can now ask 
questions or make requests which can be handled by the 
5 assistant with the aid of the personal user data and 

settings from the user database 9. For example, the e-mail 
address of the user is stored in the database 9 and will be 
read out from the database 9 in the event of a call by the 
user. The. user 1 can now ask the question "Is there mail 
10 for me?", to which the assistant, with the aid of the 

user's e-mail address - that does not need to be displayed 
on the screen 11, can call up the e-mail of the user with a 
few simple actions and answer the question. Similarly, the 
user can ask the question "How are my shares doing?", which 
15 the assistant can answer simply and quickly if the user's 
share funds are stored in the personal data and can be read 
out in response to a call. Controlled by the read-out 
funds, an internal or external data system 13 or 15 
respectively, which can provide the requested share prices, 
20 is consulted. Another example is the request by user 1 for 
the assistant to phone "home" to say that the user 1 will 
be coming home later. In this case, the "home" telephone 
number is read from the database 9 and either displayed on 
the screen 11 and used by the assistant for dialling, or 
25 incorporated as (invisible) attribute in a screen object 
("Home telephone ") that can be activated by the screen 
mouse in order to dial the "home" telephone number and then 
to switch through to the user 1. The user can. also ask the 
"operator" to make an appointment with another person, 
30 either by phone or via a shared diary system 13 or 15. For 
this as well, the "operator" needs the access codes etc. 
for the diary system, which are read out from the database 
9. After being made, appointments are entered in the diary 
system 13 or 15 respectively, possibly after consultation 
35 with the user 1 via the voice part 10. 

The users database 9 can, via the connecting means 3, be 
accessed and modified by the users 1. To enable the 
assistant to provide the user with data from various types 
of data systems, the server 6 is connected to various 
40 internal data systems 13 and/or external data systems 15, 
which can be operated by the assistant 8, making use of 
user data of the calling user 1 called up by the server 6 
from the users database 9. The data system can, as already 
mentioned, be an internal or external e-mail or diary 
4 5 system, an information system based on, for example, the 
Internet or intranet, a Short Message System (SMS) , a fax 
system or a unified messaging system. 

In this way, the personal "operator" can, with the aid of 
server 6 and servers 13 and 15 operable from server 6, 
50 offer a wide range of services to each user 1 individually 
in an efficient but nevertheless personal (non-mechanical) 
manner. 
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It is pointed that the system according to the invention ,is 
based on the deployment of a human "operator" who, with the 
support of server 6 and servers 13 and 15, answers the 
users and serves them by setting up telephone connections 
to the network 5, obtaining information and/or performing 
tasks, making appointments, sending messages, etc. Although 
the system makes use of a human "operator", it is 
nevertheless envisaged that some tasks could be taken over 
by an "electronic operator", via "voice recognition and 
"voice response" (VR) , etc. For this purpose it is 
envisaged that the server 6 could comprise modules which 
record actual dialogues held between the users and the 
human "operator" and, based on this input, could be 
developed and trained to respond to data for VR. 
Although the main aim of the present invention is to 
improve voice-based communication between the personal 
assistant" 8 and the users 1, the invention is also useful 
if the communication is based on data. The "personal 
assistant" server 6 can, by offering the "personal 
assistant" specific user data and making user-specific , 
settings, also provide assistance and support if the 
communication between the user and the "P?" 0 ^ 
proceeds via their (alphanumeric or graphic) data terminals 
11 or 12 respectively. For such data communication as well, 
the "personal assistant" server can read out from the 
database 9 the. user-specific data and settings based on the 
address of the "calling" data terminal 12 of the user and 
use them in the further interaction with the user. 
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CLAIMS • ■ * • , „,„ 

1. Communication system comprising user terminals (2,1^) 

operable by users (1) and connecting means (3) for 
connecting the user terminals to a telecommunications 
network (5,14), characterised by a "personal assistant" 
server (6) connected to the connecting means, to which 
server a "personal assistant" terminal (7) is connected, 
which can be operated by a human "personal assistant" (8) 
who can be called up by the users via the connecting means. 

2. Communication system according to claim 1, 
characterised in that the server (6) is connected to a 
database (9) containing user-specific data and/or settings 
of the various users (1), whereby the server, on detection 
of a call from a user terminal (2,12) to the "personal 
assistant" terminal (7), reads out those user-specific data 
and/or settings of the calling user from the database. 

3. communication system according to claim 2, 
characterised in that the users database (9) is connected 
via the connecting means (3) to user data terminals (12), 
and the users (1) can read or modify their user-specific 
data and/or settings. 

4. Communication system according to claim 2, whereby the 
user terminals are voice terminals (2) and the "personal 
assistant" terminal (7) comprises a voice part (10) and a 
data part (11), characterised in that the server (6), on 
detection of a call from a user voice terminal (2) to the 
voice part (10) of the "personal assistant" terminal (7), 
reads out the user-specific data and/or settings of the 
calling user from the database and makes these data 
available to the data part (11) of the "personal assistant" 
terminal (7) . _ 

5. Communication system according to claim 2, 
characterised in that the server (6) is connected to one or 
more internal or external data systems (13,15) which are 

35 accessible and operable by the "personal assistant" (8) by 
means of the "personal assistant" terminal (7). 

6. Communication system according to claim 5, 
characterised in that the data system (13,15) in question 
is operable by the "personal assistant" (8) by means of the 

0 "personal assistant" terminal (7) with control by user- 
specific data and/or settings of the calling user (1) 
called up by the server (6) from the users database (9). 

7. Communication system according to claim 5, 
characterised in that the data system (13,15) is an e-mail 
system that is operable by the "personal assistant" 
terminal (7) with control by the user-specific data and/or 
settings. 

8. Communication system according to claim 5, 
characterised in that the data system (13,15) is an 
electronic diary that is operable by the "personal 
assistant" terminal (7) with control by the user-specific 
data and/or settings. 
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9. Communication system according to claim 5, 
characterised, in that the data system is an information 
system that is operable by the "personal assistant" 
terminal (7) with control by the user-specific data and/or 
settings. 

10. Communication system according to claim 5, 
characterised in that the data system is an SMS system that 
is operable by the "personal assistant" terminal (7) with 
control by the user-specific data and/or settings. 

11. Communication system according to claim 5, 
characterised in that the data system is a fax system that 
is operable by the "personal assistant" terminal (7) with 
control by the user-specific data and/or settings. 

12. Communication system according to claim 5, 

15 characterised in that the data system is a unified 
messaging system that is operable by the "personal 
assistant" terminal (7) with control by the user-specific 
data and/or settings. 

13. Personal assistant server (6) comprising means for 
20 making a connection, via connecting means (3), to user.. 

terminals (2,12) operable by users (1) and the onward 
connection of said user terminals to a telecommunications 
network (5), characterised by means for connecting a 
personal assistant terminal (7) that can be operated by a 
25 human "personal assistant" (8) who can be called up by the 
users via the connecting means, whereby the server (6) is 
connected to a users database (9) containing user-specific 
data and/or settings about the various users (1), whereby 
the server, on detection of a call from a user terminal 
(2,12) to the "personal assistant" terminal (7), reads out 
the data of the calling user from the database. 

14. Personal assistant server according to claim 13, 
characterised by means for connecting the server (6) to one 
or more internal or external data systems (13,15) which are 

35 accessible and operable by the "personal assistant" (8) by 
means of the "personal assistant" terminal (7), with 
control by user-specific data and/or settings of the 
calling user (1) called up by the server (6) from the users 
database (9) . . 

15. Personal assistant server according to claim 1J, 
whereby the user terminals are voice terminals (2) and the 
"personal assistant" terminal (7) comprises a voice part 
(10), characterised by means for recording and processing 
actual dialogues between the voice part (10) of the 
"personal assistant" terminal (7) and the voice terminal 
(2) of the user (1) . 
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